Mobile terminal and menu control method thereof

ABSTRACT

A mobile terminal including an input unit configured to receive an input to activate a voice recognition function on the mobile terminal and a memory configured to store multiple domains related to menus and operations of the mobile terminal. It further includes a controller configured to access a specific domain among the multiple domains included in the memory based on the received input to activate the voice recognition function, to recognize user speech based on a language model and an acoustic model of the accessed domain, and to determine at least one menu and operation of the mobile terminal based on the accessed specific domain and the recognized user speech.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application claims priority to Korean Applications No.10-2008-0032841 and No. 10-2008-0032843, both filed in Korea on Apr. 8,2008, and Korean Application No. 10-2008-0033350 filed in Korea on Apr.10, 2008, the entire contents of which are hereby incorporated byreference in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile terminal and correspondingmethod capable of improving a voice recognition rate by setting a domainfor voice recognition into information relating to specific menus orservices.

2. Description of the Background Art

Mobile terminals now provide many additional services beside the basiccall service. For example, user's can now access the Internet, playgames, watch videos, listen to music, capture images and videos, recordaudio files, etc. Mobile terminals also now provide broadcastingprograms such that user can watch television shows, sporting programs,videos etc.

In addition, because the functions included with mobile terminals havesignificantly increased, the user interfaces have also become moresophisticated. For example, user interfaces now include touch screensallowing the user to touch and select a particular item or menu option.The mobile terminals also include very limited voice recognitionfunctions that allow a user to perform rudimentary functions. However,the error rate in determining the meaning the user's voice instructionis too high, and thus users generally do not use the limited voicerecognition features on the terminal.

SUMMARY OF THE INVENTION

Accordingly, one object of the present invention is to address theabove-noted and other problems.

Another object of the present invention to provide a mobile terminal andcorresponding method for controlling menus relating to specificfunctions or services thereof by recognizing a meaning of a voicecommand based on a context and content.

Yet another object of the present invention to provide a mobile terminaland corresponding method that significantly improves a voice recognitionrate by specifying a domain for voice recognition into a domain relatingto specific menus or services.

Still another object of the present invention to provide a mobileterminal and corresponding method that controls menus relating tospecific functions or services by applying one or more user's interfaces(UI) thereof while a voice recognition function is activated so as todetect a user's manipulation.

Yet another object of the present invention to provide a mobile terminaland corresponding method for controlling menus relating to specificfunctions or services even by a beginner user through his or her voicecommand, by providing help information with respect to input of thevoice command according to an operation state or an operation modethereof.

To achieve these and other advantages and in accordance with the purposeof the present invention, as embodied and broadly described herein,provides in one aspect a mobile terminal, including an input unitconfigured to receive an input to activate a voice recognition functionon the mobile terminal, a memory configured to store multiple domainsrelated to menus and operations of the mobile terminal, and a controllerconfigured to access a specific domain among the multiple domainsincluded in the memory based on the received input to activate the voicerecognition function, to recognize user speech based on a language modeland an acoustic model of the accessed domain, and to determine at leastone menu and operation of the mobile terminal based on the accessedspecific domain and the recognized user speech.

In another aspect, the present invention provides a method ofcontrolling a mobile terminal The method includes receiving an input toactivate a voice recognition function on the mobile terminal, accessinga specific domain among stored multiple domains included in a memory ofthe mobile terminal based on the received input to activate the voicerecognition function, recognizing user speech based on a language modeland an acoustic model of the accessed domain, and outputting at leastone menu and operation of the mobile terminal based on the accessedspecific domain and the recognized user speech.

Further scope of applicability of the present invention will becomeapparent from the detailed description given hereinafter. However, itshould be understood that the detailed description and specificexamples, while indicating preferred embodiments of the invention, aregiven by illustration only, since various changes and modificationswithin the spirit and scope of the invention will become apparent tothose skilled in the art from this detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will become more fully understood from thedetailed description given hereinbelow and the accompanying drawings,which are given by illustration only, and thus are not limitative of thepresent invention, and wherein:

FIG. 1 is a block diagram of a mobile terminal according to anembodiment of the present invention;

FIG. 2 is a front perspective view of a mobile terminal according to anembodiment of the present invention;

FIG. 3 is a rear perspective view of the mobile terminal shown in FIG.2;

FIG. 4 is an overview of a communication system operable with the mobileterminal of the present invention;

FIG. 5 is a flowchart illustrating a menu control method for a mobileterminal through a voice command according to an embodiment of thepresent invention;

FIG. 6A is an overview showing a method for activating a voicerecognition function for a mobile terminal according to an embodiment ofthe present invention;

FIGS. 6B and 6C are overviews showing a method for outputting helpinformation of a mobile terminal according to an embodiment of thepresent invention;

FIG. 7A is a flowchart showing a method for recognizing a voice commandof a mobile terminal according to an embodiment of the presentinvention;

FIG. 7B is an overview showing a method for recognizing a voice commandof a mobile terminal according to an embodiment of the presentinvention;

FIG. 8 is an overview showing a method for displaying menus for a voicerecognition rate of a mobile terminal according to an embodiment of thepresent invention;

FIG. 9 is an overview showing a method for recognizing a voice commandof a mobile terminal according to another embodiment of the presentinvention;

FIG. 10 is an overview of a configuration of databases used as areference for voice command recognition of a mobile terminal accordingto an embodiment of the present invention;

FIG. 11 is an overview showing a state that a voice recognition functionof a mobile terminal is being executed according to an embodiment of thepresent invention;

FIG. 12 is an overview showing a method for processing sub-commandsrelating to a specific menu through a voice command in a mobile terminalaccording to an embodiment of the present invention;

FIG. 13 is an overview showing a method for searching a subway mapthrough a voice command in a mobile terminal according to an embodimentof the present invention;

FIG. 14 is an overview showing a method for reproducing multimedia filesthrough a voice command in a mobile terminal according to an embodimentof the present invention;

FIG. 15 is an overview showing a method for sending e-mail through avoice command in a mobile terminal according to an embodiment of thepresent invention;

FIG. 16 is an overview showing a method for performing a phone callthrough a voice command in a mobile terminal according to an embodimentof the present invention;

FIG. 17 is an overview showing a method for using phone-book informationthrough a voice command in a mobile terminal according to an embodimentof the present invention;

FIG. 18 is an overview showing a method for changing a background screenthrough a voice command in a mobile terminal according to an embodimentof the present invention; and

FIG. 19 is an overview showing a method for reproducing multimedia filesthrough a voice command in a mobile terminal according to an embodimentof the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings.

FIG. 1 is a block diagram of a mobile terminal 100 according to anembodiment of the present invention. As shown, the mobile terminal 100includes a wireless communication unit 110 having one or more componentswhich permits wireless communication between the mobile terminal 100 anda wireless communication system or network within which the mobileterminal is located.

For example, the wireless communication unit 110 includes a broadcastreceiving module 111 that receives a broadcast signal and/or broadcastassociated information from an external broadcast managing entity via abroadcast channel. The broadcast channel may include a satellite channeland a terrestrial channel.

In addition, the broadcast managing entity generally refers to a systemwhich transmits a broadcast signal and/or broadcast associatedinformation. Examples of broadcast associated information includeinformation associated with a broadcast channel, a broadcast program, abroadcast service provider, etc. For instance, broadcast associatedinformation may include an electronic program guide (EPG) of digitalmultimedia broadcasting (DMB) and electronic service guide (ESG) ofdigital video broadcast-handheld (DVB-H).

In addition, the broadcast signal may be implemented as a TV broadcastsignal, a radio broadcast signal, and a data broadcast signal, amongothers. The broadcast signal may further include a broadcast signalcombined with a TV or radio broadcast signal.

The broadcast receiving module 111 is also configured to receivebroadcast signals transmitted from various types of broadcast systems.For example, such broadcasting systems include the digital multimediabroadcasting-terrestrial (DMB-T) system, the digital multimediabroadcasting-satellite (DMB-S) system, the digital videobroadcast-handheld (DVB-H) system, the data broadcasting system known asmedia forward link only (MediaFLO®) and the integrated services digitalbroadcast-terrestrial (ISDB-T) system among others. Receiving multicastsignals is also possible. Further, data received by the broadcastreceiving module 111 may be stored in a suitable device, such as amemory 160.

The wireless communication unit 110 also includes a mobile communicationmodule 112 that transmits/receives wireless signals to/from one or morenetwork entities (e.g., base station, Node-B). Such signals mayrepresent audio, video, multimedia, control signaling, and data, amongothers.

Also included is a wireless Internet module 113 that supports Internetaccess for the mobile terminal. The module 113 may be internally orexternally coupled to the terminal. The wireless communication unit 110also includes a short-range communication module 114 that facilitatesrelatively short-range communications. Suitable technologies forimplementing this module include radio frequency identification (RFID),infrared data association (IrDA), ultra-wideband (UWB), as well at thenetworking technologies commonly referred to as Bluetooth and ZigBee, toname a few.

A position-location module 115 is also included in the wirelesscommunication unit 110 and identifies or otherwise obtains the locationof the mobile terminal 100. The position-location module 115 may beimplemented using global positioning system (GPS) components whichcooperate with associated satellites, network components, andcombinations thereof.

In addition, as shown in FIG. 1, the mobile terminal 100 also includesan Audio/video (A/V) input unit 120 that provides audio or video signalsto the mobile terminal 100. As shown, the A/V input unit 120 includes acamera 121 and a microphone 122. The camera 121 receives and processesimage frames of still pictures or video.

Further, the microphone 122 receives an external audio signal while theportable device is in a particular mode, such as a phone call mode,recording mode and voice recognition mode. The received audio signal isthen processed and converted into digital data. Also, the portabledevice, and in particular, the A/V input unit 120, includes assortednoise removing algorithms to remove noise generated in the course ofreceiving the external audio signal. In addition, data generated by theA/V input unit 120 may be stored in the memory 160, utilized by anoutput unit 150, or transmitted via one or more modules of thecommunication unit 110. If desired, two or more microphones and/orcameras may be used.

The mobile terminal 100 also includes a user input unit 130 thatgenerates input data responsive to user manipulation of an associatedinput device or devices. Examples of such devices include a keypad, adome switch, a touchpad (e.g., static pressure/capacitance), a jog wheeland a jog switch. A specific example is one in which the user input unit130 is configured as a touchpad in cooperation with a touch screendisplay, which will be described in more detail below.

A sensing unit 140 is also included in the mobile terminal 100 andprovides status measurements of various aspects of the mobile terminal100. For instance, the sensing unit 140 may detect an open/close statusof the mobile terminal 100, relative positioning of components (e.g., adisplay and keypad) of the mobile terminal 100, a change of position ofthe mobile terminal 100 or a component of the mobile terminal 100, apresence or absence of user contact with the mobile terminal 100,orientation or acceleration/deceleration of the mobile terminal 100,etc.

As an example, when the mobile terminal 100 is a slide-type mobileterminal, the sensing unit 140 may sense whether a sliding portion ofthe mobile terminal 100 is open or closed. Other examples include thesensing unit 140 sensing the presence or absence of power provided by apower supply 190, the presence or absence of a coupling or otherconnection between an interface unit 170 and an external device, etc.

Further, the interface unit 170 is often implemented to couple themobile terminal 100 with external devices. Typical external devicesinclude wired/wireless headphones, external chargers, power supplies,storage devices configured to store data (e.g., audio, video, pictures,etc.), earphones, and microphones, among others. In addition, theinterface unit 170 may be configured using a wired/wireless data port, acard socket (e.g., for coupling to a memory card, a subscriber identitymodule (SIM) card, a user identity module (UIM) card, a removable useridentity module (RUIM) card, etc.), audio input/output ports and videoinput/output ports.

The output unit 150 generally includes various components which supportthe output requirements of the mobile terminal 100. The mobile terminal100 also includes a display 151 that visually displays informationassociated with the mobile terminal 100. For instance, if the mobileterminal 100 is operating in a phone call mode, the display 151 willgenerally provide a user interface or graphical user interface whichincludes information associated with placing, conducting, andterminating a phone call. As another example, if the mobile terminal 100is in a video call mode or a photographing mode, the display 151 mayadditionally or alternatively display images which are associated withthese modes.

Further, the display 151 also preferably includes a touch screen workingin cooperation with an input device, such as a touchpad. Thisconfiguration permits the display 151 to function both as an outputdevice and an input device. In addition, the display 151 may beimplemented using display technologies including, for example, a liquidcrystal display (LCD), a thin film transistor-liquid crystal display(TFT-LCD), an organic light-emitting diode display (OLED), a flexibledisplay and a three-dimensional display.

The mobile terminal 100 may also include one or more of such displays.An example of a two-display embodiment is one in which one display isconfigured as an internal display (viewable when the terminal is in anopened position) and a second display configured as an external display(viewable in both the open and closed positions).

FIG. 1 further shows the output unit 150 having an audio output module152 which supports the audio output requirements of the mobile terminal100. The audio output module 152 may be implemented using one or morespeakers, buzzers, other audio producing devices, and combinationsthereof. Further, the audio output module 152 functions in various modesincluding a call-receiving mode, a call-placing mode, a recording mode,a voice recognition mode and a broadcast reception mode. Duringoperation, the audio output module 152 outputs audio relating to aparticular function (e.g., call received, message received, and errors).

In addition, the output unit 150 is further shown having an alarm 153,which is used to signal or otherwise identify the occurrence of aparticular event associated with the mobile terminal 100. Alarm eventsinclude a call received, a message received and user input received. Anexample of such output includes the providing of tactile sensations(e.g., vibration) to a user. For instance, the alarm 153 may beconfigured to vibrate responsive to the mobile terminal 100 receiving acall or message.

As another example, a vibration is provided by the alarm 153 responsiveto receiving user input at the mobile terminal 100, thus providing atactile feedback mechanism. Further, the various outputs provided by thecomponents of the output unit 150 may be separately performed, or suchoutput may be performed using any combination of such components.

In addition, the memory 160 is used to store various types of data tosupport the processing, control, and storage requirements of the mobileterminal 100. Examples of such data include program instructions forapplications operating on the mobile terminal 100, call history, contactdata, phonebook data, messages, pictures, video, etc.

Further, the memory 160 shown in FIG. 1 may be implemented using anytype or combination of suitable volatile and non-volatile memory orstorage devices including random access memory (RAM), static randomaccess memory (SRAM), electrically erasable programmable read-onlymemory (EEPROM), erasable programmable read-only memory (EPROM),programmable read-only memory (PROM), read-only memory (ROM), magneticmemory, flash memory, magnetic or optical disk, card-type memory, orother similar memory or data storage device.

The terminal 100 also includes a controller 180 that typically controlsthe overall operations of the mobile terminal 100. For instance, thecontroller 180 performs the control and processing associated with voicecalls, data communications, instant message communications, video calls,camera operations and recording operations. As shown in FIG. 1, thecontroller 180 may also include a multimedia module 181 for providingmultimedia playback functions. The multimedia module 181 may beconfigured as part of the controller 180, or may be implemented as aseparate component.

In addition, a power supply 190 provides power used by the variouscomponents for the portable device. The provided power may be internalpower, external power, or combinations thereof.

Next, FIG. 2 is a front side view of the mobile terminal 100 accordingto an embodiment of the present invention. As shown in FIG. 2, themobile terminal 100 includes a first body 200 configured to slidablycooperate with a second body 205. The user input unit 130 described inFIG. 1 may include a first input unit such as function keys 210, asecond input unit such as a keypad 215, and a third input unit such asside keys 245.

The function keys 210 are associated with the first body 200, and thekeypad 215 is associated with the second body 205. The keypad 215includes various keys (e.g., numbers, characters, and symbols) to enablea user to place a call, prepare a text or multimedia message, andotherwise operate the mobile terminal 100.

In addition, the first body 200 slides relative to the second body 205between open and closed positions. In a closed position, the first body200 is positioned over the second body 205 in such a manner that thekeypad 215 is substantially or completely obscured by the first body200. In the open position, user access to the keypad 215, as well as thedisplay 151 and function keys 210, is possible. The function keys 210are convenient to a user for entering commands such as start, stop andscroll commands.

Further, the mobile terminal 100 is operable in either a standby mode(e.g., able to receive a call or message, receive and respond to networkcontrol signaling), or an active call mode. Typically, the mobileterminal 100 functions in a standby mode when in the closed position,and an active mode when in the open position. However, the modeconfiguration may be changed as required or desired.

In addition, the first body 200 is formed from a first case 220 and asecond case 225, and the second body 205 is formed from a first case 230and a second case 235. The first and second cases are preferably formedfrom a suitably ridge material such as injection molded plastic, orformed using metallic material such as stainless steel (STS) andtitanium (Ti).

If desired, one or more intermediate cases may be provided between thefirst and second cases of one or both of the first and second bodies 200and 205. In addition, the first and second bodies 200 and 205 are sizedto receive electronic components used to support the operation of themobile terminal 100.

Also, the first body 200 includes the camera 121 and the audio outputunit 152, which is configured as a speaker, positioned relative to thedisplay 151. The camera 121 may also be constructed in such a mannerthat it can be selectively positioned (e.g., rotated, swiveled, etc.)relative to the first body 200.

Further, the function keys 210 are positioned adjacent to a lower sideof the display 151. As discussed above, the display 151 can beimplemented as an LCD or OLED. The display 151 may also be configured asa touch screen having an underlying touchpad which generates signalsresponsive to user contact (e.g., finger, stylus, etc.) with the touchscreen.

Also, the second body 205 includes the microphone 122 positionedadjacent to the keypad 215, and side keys 245, which are one type of auser input unit, positioned along the side of the second body 205.Preferably, the side keys 245 are configured as hot keys, such that theside keys 245 are associated with a particular function of the mobileterminal 100. As shown, the interface unit 170 is positioned adjacent tothe side keys 245, and the power supply 190 in a form of a battery islocated on a lower portion of the second body 205.

FIG. 3 is a rear side view of the mobile terminal 100 shown in FIG. 2.As shown in FIG. 3, the second body 205 includes the camera 121, and anassociated flash 250 and mirror 255. The flash 250 operates inconjunction with the camera 121 of the second body 205, and the mirror255 is useful for assisting a user to position the camera 121 in aself-portrait mode. In addition, the camera 121 of the second body 205faces a direction which is opposite to a direction faced by the camera121 of the first body 200 shown in FIG. 2.

In addition, each of the cameras 121 of the first and second bodies 200and 205 may have the same or different capabilities. For example, in oneembodiment, the camera 121 of the first body 200 operates with arelatively lower resolution than the camera 121 of the second body 205.Such an arrangement works well during a video conference call, forexample, in which reverse link bandwidth capabilities may be limited.Further, the relatively higher resolution of the camera 121 of thesecond body 205 (FIG. 3) is useful for obtaining higher quality picturesfor later use.

The second body 205 also includes the audio output module 152 configuredas a speaker, and which is located on an upper side of the second body205. The audio output modules of the first and second bodies 200 and 205may also cooperate together to provide stereo output. Moreover, eitheror both of these audio output modules may be configured to operate as aspeakerphone.

The terminal 100 also includes a broadcast signal receiving antenna 260located at an upper end of the second body 205. The antenna 260functions in cooperation with the broadcast receiving module 111 (FIG.1). If desired, the antenna 260 may be fixed or configured to retractinto the second body 205. Further, the rear side of the first body 200includes a slide module 265, which slidably couples with a correspondingslide module located on the front side of the second body 205.

In addition, the illustrated arrangement of the various components ofthe first and second bodies 200 and 205 may be modified as required ordesired. In general, some or all of the components of one body mayalternatively be implemented on the other body. Further, the locationand relative positioning of such components may be positioned atlocations which differ from those shown by the representative figures.

In addition, the mobile terminal 100 of FIGS. 1-3 may be configured tooperate within a communication system which transmits data via frames orpackets, including both wireless and wireline communication systems, andsatellite-based communication systems. Such communication systemsutilize different air interfaces and/or physical layers.

Examples of such air interfaces utilized by the communication systemsinclude, for example, frequency division multiple access (FDMA), timedivision multiple access (TDMA), code division multiple access (CDMA),and universal mobile telecommunications system (UMTS), the long termevolution (LTE) of the UMTS, and the global system for mobilecommunications (GSM). By way of a non-limiting example only, furtherdescription will relate to a CDMA communication system, but suchteachings apply equally to other system types.

Next, FIG. 4 illustrates a CDMA wireless communication system having aplurality of mobile terminals 100, a plurality of base stations 270, aplurality of base station controllers (BSCs) 275, and a mobile switchingcenter (MSC) 280.

The MSC 280 is configured to interface with a public switch telephonenetwork (PSTN) 290, and the MSC 280 is also configured to interface withthe BSCs 275. Further, the BSCs 275 are coupled to the base stations 270via backhaul lines. In addition, the backhaul lines may be configured inaccordance with any of several interfaces including, for example, E1/T1,ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Further, the system mayinclude more than two BSCs 275.

Also, each base station 270 may include one or more sectors, each sectorhaving an omnidirectional antenna or an antenna pointed in a particulardirection radially away from the base station 270. Alternatively, eachsector may include two antennas for diversity reception. In addition,each base station 270 may be configured to support a plurality offrequency assignments, with each frequency assignment having aparticular spectrum (e.g., 1.25 MHz, 5 MHz).

The intersection of a sector and frequency assignment may be referred toas a CDMA channel. The base stations 270 may also be referred to as basestation transceiver subsystems (BTSs). In some instances, the term “basestation” may be used to refer collectively to a BSC 275, and one or morebase stations 270.

The base stations 270 may also be denoted as “cell sites.”Alternatively, individual sectors of a given base station 270 may bereferred to as cell sites. Further, a terrestrial digital multimediabroadcasting (DMB) transmitter 295 is shown broadcasting to mobileterminals 100 operating within the system.

In addition, the broadcast receiving module 111 (FIG. 1) of the mobileterminal 100 is typically configured to receive broadcast signalstransmitted by the DMB transmitter 295. Similar arrangements may beimplemented for other types of broadcast and multicast signaling asdiscussed above.

FIG. 4 further illustrates several global positioning system (GPS)satellites 300. Such satellites facilitate locating the position of someor all of the mobile terminals 100. In FIG. 4, two satellites are shown,but positioning information may be obtained with greater or fewersatellites.

In addition, the position-location module 115 (FIG. 1) of the mobileterminal 100 is typically configured to cooperate with the satellites300 to obtain desired position information. However, other types ofposition detection technology, such as location technology that may beused in addition to or instead of GPS location technology, mayalternatively be implemented. Some or all of the GPS satellites 300 mayalternatively or additionally be configured to provide satellite DMBtransmissions.

Further, during typical operation of the wireless communication system,the base stations 270 receive sets of reverse-link signals from variousmobile terminals 100. The mobile terminals 100 engage in calls,messaging, and other communications.

In addition, each reverse-link signal received by a given base station270 is processed within that base station 270, and the resulting data isforwarded to an associated BSC 275. The BSC 275 provides call resourceallocation and mobility management functionality including soft handoffsbetween the base stations 270.

Further, the BSCs 275 also route the received data to the MSC 280, whichprovides additional routing services for interfacing with the PSTN 290.Similarly, the PSTN interfaces with the MSC 280, and the MSC 280interfaces with the BSCs 275. The BSCs 275 also control the basestations 270 to transmit sets of forward-link signals to the mobileterminals 100.

In the following description, a control method applicable to theabove-configured mobile terminal 100 is explained with respect tovarious embodiments. However, the following embodiments can beimplemented independently or through combinations thereof. In addition,in the following description, it is assumed that the display 151includes a touch screen. Further, the touch screen or its screen will beindicated by the reference number ‘400’.

In an embodiment of the present invention, the mobile terminal specifiesa domain (or information search range) of databases used as a referencefor voice command recognition into a domain relating to specific menusor services. Accordingly, the recognition rate for a voice command isimproved, and the overall amount of resources used by the mobileterminal is decreased.

Further, the domain of a database used as a reference for voice commandrecognition can be specified through an environment setting menu of themobile terminal. Also, once a voice recognition function is activated,the specified domain may be automatically applied.

Hereinafter, the preset domain of a database for voice commandrecognition is assumed to include information relating to menuscurrently displayed on the display 151, or information relating tosub-menus of one of the menus.

Next, FIG. 5 is a flowchart showing a menu control method for a mobileterminal through a voice command according to an embodiment of thepresent invention. FIG. 1 will also be referred to in the followingdescriptions. As shown in FIG. 5, the controller 180 determines if thevoice recognition function has been activated (S101).

Further, the voice recognition function may be activated by the userselecting hardware buttons on the mobile terminal, or soft touch buttonsdisplayed on the display module 151. The user may also activate thevoice recognition function by manipulating specific menus displayed onthe display 151. The voice recognition function may also be activated bythe user generating a specific sound or sound effects, by short orlong-range wireless signals, or by the user's body information such ashand gesture or body gesture.

In more detail, the specific sound or sound effects may include impactsounds having a level more than a specific level. Further, the specificsound or sound effects may be detected using a sound level detectingalgorithm. In addition, the sound level detecting algorithm ispreferably more simple than a voice recognition algorithm, and thusconsumes less resources of the mobile terminal. Also, the sound leveldetecting algorithm (or circuit) may be individually implemented fromthe voice recognition algorithm or circuit, or may be implemented so asto specifying some functions of the voice recognition algorithm.

In addition, the wireless signals may be received through the wirelesscommunication unit 110, and the user's hand or body gestures may bereceived through the sensing unit 140. Thus, in an embodiment of thepresent invention, the wireless communication unit 110, the user inputunit 130, and the sensing unit 140 may be referred to as a signal inputunit. Further, the voice recognition function may also be terminated ina similar manner.

Having the user physically activate the voice recognition function isparticularly advantageous, because the user is more aware they are aboutto use voice commands to control the terminal. That is, because the userhas to first perform a physical manipulation of the terminal, he or sheintuitively recognizes they are going to input a voice command orinstruction into the terminal, and therefore speak more clearly orslowly to thereby activate a particular function. Thus, because the userspeaks more clearly or more slowly, for example, the probability ofaccurately recognizing the voice instruction increases. That is, in anembodiment of the present invention, the activation of the voicerecognition function is performed by a physical manipulation of a buttonon the terminal rather than activating the voice recognition function byspeaking into the terminal.

Further, the controller 180 may start or terminate activation of thevoice recognition function based on how many times the user touches aparticular button or portion of the touch screen, how long the usertouches a particular button or portion of the touch screen, etc. Theuser can also set how the controller 180 is to activate the voicerecognition function using an appropriate menu option provided by thepresent invention. For example, the user can select a menu option on theterminal that includes 1) set activation of voice recognition based on Xnumber of times the voice activation button is selected, 2) setactivation of voice recognition based on X amount of time the voiceactivation button is selected, 3) set activation of voice recognitionwhen the buttons X and Y are selected, etc. The user can then enter thevalues of X and Y in order to variably set how the controller 180determines the voice activation function is activated. Thus, accordingto an embodiment of the present invention, the user is actively engagedwith the voice activation function of their own mobile terminal, whichincreases the probability that the controller 180 will determine thecorrect function corresponding to the user's voice instruction, andwhich allows the user to tailor the voice activation function accordingto his or her needs.

The controller 180 may also maintain the activated state of the voicerecognition function while the designated button(s) are touched orselected, and stop the voice recognition function when the designatedbutton(s) are released. Alternatively, the controller 180 can maintainthe activation of the voice recognition function for a predeterminedtime period after the designated button(s) are touched or selected, andstop or terminate the voice recognition function when the predeterminedtime period ends. In yet another embodiment, the controller 180 canstore received voice instructions in the memory 160 while the voicerecognition function is maintained in the activated state.

In addition, as shown in FIG. 5, a domain of the database used as areference for recognizing the meaning of the voice command is specifiedto information relating to specific functions or menus on the terminal(S102). For instance, the specified domain of database may beinformation relating to menus currently displayed on the display 151, orinformation relating to sub-menus of one of the displayed menus.Further, because the domain of database is specified, the recognitionrate for the input voice command is improved. Examples of domainsinclude an e-mail domain, a received calls domain, and multimediadomain, etc.

Also, the information relating to sub-menus may be configured as data ina database. For example, the information may be configured in the formof a keyword, and a plurality of information may correspond to onefunction or menu. In addition, the database can be a plurality ofdatabases according to features of information, and may be stored in thememory 160.

Further, the information in the database(s) may be advantageouslyupdated or renewed through a learning process. Each domain of therespective databases may also be specified into a domain relating tofunctions or menus being currently output, so as to enhance arecognition rate for a voice command. The domain may also change as menusteps continue to progress.

Once the voice recognition function is activated (Yes in S101) and thedomain has been specified (S102), the controller 180 determines if theuser has input a voice command (S103). When the controller 180determines the user has input the voice command (Yes in S103), thecontroller 180 analyzes a context and content of a voice command orinstruction input through the microphone 122 based on a specificdatabase, thereby judging a meaning of the voice command (S104).

Further, the controller 180 can determine the meaning of the voiceinstruction or command based on a language model and an acoustic modelof the accessed domain. In more detail, the language model relates tothe words themselves and the acoustic model corresponds to the way thewords are spoken (e.g., frequency components of the spoken words orphrases). Using the language and acoustic models together with aspecific domain and a state of the mobile terminal 100, the controller180 can effectively determine the meaning of the input voiceinstructions or command.

Further, the controller 180 may immediately start the process forjudging the meaning of the input voice command when the user releasesthe activation of the voice recognition function when the controller 180stores the input voice command in the memory 160, or may simultaneouslyperform the voice activation function when the voice command is input.

In addition, if the voice command has not been fully input (No in S103),the controller 180 can still perform other functions. For example, ifthe user performs another action by touching a menu option, etc. orpresses a button on the terminal (Yes in S109), the controller 180performs the corresponding selected function (S110).

Further, after the controller 180 determines the meaning of the inputvoice command in step S104, the controller 180 outputs a result value ofthe meaning (S105). That is, the result value may include controlsignals for executing menus relating to functions or servicescorresponding to the determined meaning, for controlling specificcomponents of the mobile terminal, etc. The result value may alsoinclude data for displaying information relating to the recognized voicecommand.

The controller may also request the user confirm the output result valueis accurate (S106). For instance, when the voice command has a lowrecognition rate or is determined to have a plurality of meanings, thecontroller 180 can output a plurality of menus relating to therespective meanings, and then execute a menu that is selected by theuser (S107). Also, the controller 180 may ask a user whether to executea specific menu having a high recognition rate, and then execute ordisplay a corresponding function or menu according to the user'sselection or response.

In addition, the controller 180 can also output a voice message askingthe user to select a particular menu or option such as “Do you want toexecute a photo album menu? Reply with Yes or No.” Then, the controller180 executes or does not execute a function corresponding to theparticular menu or option based on the user's response. If the user doesnot respond in a particular time period (e.g., five seconds), thecontroller 180 can also immediately execute the particular menu oroption. That is, if there is no response from the user, the controller180 may automatically execute the function or menu by judging thenon-response as a positive answer.

Further, the user may reply to the question from the controller 180using his or her voice (e.g., Yes or No) or via other input units suchas hardware or software buttons, a touch pad, etc. In addition, in stepS106, if there is a negative answer from the user (No in S106), that is,if a meaning of the voice command is not precisely judged, thecontroller 180 may execute an additional error processing step (S108).

That is, the error processing step may be performed by again receivinginput of a voice command, or may be performed by displaying a pluralityof menus having a recognition rate more than a certain level or aplurality of menus that may be judged to have similar meanings. The usercan then select one of the plurality of menus. Also, when the number offunctions or menus having a recognition rate more than a certain levelis less than a preset number (e.g., two), the controller 180 canautomatically execute the corresponding function or menu.

Next, FIG. 6A is an overview showing a method for activating a voicerecognition function for a mobile terminal according to an embodiment ofthe present invention. As shown in the display screen 410, the user canactivate the voice recognition function by touching a soft button 411.The user can also terminate the voice recognition function by releasingthe soft button 411. In more detail, the user can activate the voicerecognition function by touching the soft button 411 and continuouslytouch the soft button 411, or hard button 412, until the voiceinstruction has been completed. That is, the user can release the softbutton 411 or hard button 412 when the voice instruction has beencompleted. Thus, the controller 180 is made aware of when the voiceinstruction is to be input and when the voice instruction has beencompleted. As discussed above, because the user is directly involved inthis determination, the accuracy of the interpretation of the inputvoice command is increased.

The controller 180 can also be configured to recognize the start of thevoice activation feature when the user first touches the soft button411, and then recognize the voice instruction has been completed whenthe user touches the soft button 411 twice, for example. Other selectionmethods are also possible. Further, as shown in the display screen 410in FIG. 6A, rather than using the soft button 411, the voice activationand de-activation can be performed by manipulating a hard button 412 onthe terminal.

In addition, the soft button 411 shown in the display screen 410 can bea single soft button that the user presses or releases toactivate/deactivate the voice recognition function or may be a menubutton that when selected produces a menu list such as “1. Start voiceactivation, and 2. Stop voice activation”). The soft button 411 can alsobe displayed during a standby state, for example.

In another example, and as shown in the display screen 420, the user canalso activate and deactivate the voice recognition function by touchingan arbitrary position of the screen. The display screen 430 illustratesyet another example in which the user activates and deactivates thevoice recognition function by producing a specific sound or soundeffects that is/are greater than a specific level. For example, the usermay clap their hands together to produce such an impact sound.

Thus, according to an embodiment of the present invention, the voicerecognition function may be implemented in two modes. For example, thevoice recognition function may be implemented in a first mode fordetecting a particular sound or sound effects more than a certain level,and in a second mode for recognizing a voice command and determining ameaning of the voice command. If the sound or sound effects is/are morethan a certain level in the first mode, the second mode is activated tothereby to recognize the voice command.

The display screen 440 illustrates still another method of the useractivating and deactivating the voice recognition function. In thisexample, the controller 180 is configured to interpret body movements ofthe user to start and stop the voice activation function. For example,and as shown in the display screen 440, the controller 180 may beconfigured to interpret the user moving his hand toward the display asan instruction to activate the voice recognition function, and the usermoving his hand away from the display as an instruction to terminate thevoice activation function. Short or long-range wireless signals may alsobe used to start and stop the voice recognition function.

Thus, according to an embodiment of the present invention, because thevoice activation function is started and stopped, the voice recognitionfunction is not continuously executed. That is, when the voicerecognition function is continuously maintained in the activated state,the amount of resources on the mobile terminal is increased compared tothe embodiment of the present invention.

Further, as discussed above with respect to FIG. 5, when the voicerecognition function is activated, the controller 180 specifies a domainof a specific database that is used as a reference for voice commandrecognition into a domain relating to a menu list on the display 151.Then, if a specific menu is selected or executed from the menu list, thedomain of the database may be specified into information relating to theselected menu or sub-menus of the specific menu.

In addition, when the specific menu is selected or executed through avoice command or touch input, the controller 180 may output helpinformation relating to sub-menus of the specific menu in the form of avoice message, or pop-up windows or balloons. For example, as shown inFIG. 6B, when the user selects the ‘multimedia menu’ via a touching orvoice operation, the controller 180 displays information relating to thesub-menus (e.g., broadcasting, camera, text viewer, game, etc.) of the‘multimedia menu’ as balloon-shaped help information 441. Alternatively,the controller 180 can output a voice signal 442 including the helpinformation. The user can then select one of the displayed help optionsusing a voice command or by a touching operation

FIG. 6C illustrates an embodiment of a user selecting a menu item usinghis or her body movements (in this example, the user's hand gesture). Inmore detail, as the user moves his or her finger closer to the menu item443, the controller 180 displays the sub-menus 444 related to the menu443. The controller 180 can recognize the user's body movement ofinformation via the sensing unit 140, for example. In addition, thedisplayed help information can be displayed so as to have a transparencyor brightness controlled according to the user's distance That is, asthe user's hand gets closer, the displayed items can be furtherhighlighted.

As discussed above, the controller 180 can be configured to determinethe starting and stopping of the voice recognition function based on avariety of different methods. For example, the user canselect/manipulate soft or hard buttons, touch an arbitrary position onthe touch screen, etc. The controller 180 can also maintain theactivation of the voice recognition function for a predetermined amountof time, and then automatically end the activation at the end of thepredetermined amount of time. Also, the controller 180 may maintain theactivation only while a specific button or touch operation is performed,and then automatically end the activation when the input is released.The controller 180 can also end the activation process when the voicecommand is no longer input for a certain amount of time.

Next, FIG. 7A is a flowchart showing a method for recognizing a voicecommand in a mobile terminal according to an embodiment of the presentinvention. Referring to FIG. 7A: when the voice recognition function isactivated, the controller 180 specifies a domain of a database that canbe used as a reference for voice command recognition into a domainrelating to a menu displayed on the display 151 or sub-menus of the menu(S201). The user also inputs the voice command (S202) using either theprecise menu name or using a natural language (spoken English, forexample).

The controller 180 then stores the input voice command in the memory 160(S203). Further, when the voice command is input under a specifieddomain, the controller 180 analyzes a context and content of the voicecommand based on the specified domain by using a voice recognitionalgorithm. Also, the voice command may be converted into text-typeinformation for analysis (S204), and then stored in a specific databaseof the memory 160. However, the step of converting the voice commandinto text-type information can be omitted.

Then, to analyze the context and content of the voice command, thecontroller 180 detects a specific word or keyword of the voice command(S205). Based on the detected words or keywords, the controller 180analyzes the context and content of the voice command and determines orjudges a meaning of the voice command by referring to information storedin the specific database (S206).

In addition, as discussed above, the database used as a referenceincludes a specified domain, and functions or menus corresponding to ameaning of the voice command judged based on the database are executed(S207). Also, because the database for voice recognition is specified toeach information relating to specific menus, the recognition rate andspeed for of recognizing the voice command are improved, and the amountof resources used on the terminal is reduced. Further, the recognitionrate indicates a matching degree with a name preset to a specific menu.

The recognition rate for an input voice command may also be judged bythe number of information relating to specific functions or menus of thevoice command. Therefore, the recognition rate for the input voicecommand is improved when the information precisely matches a specificfunction or menu (e.g., menu name) that is included in the voicecommand.

In more detail, FIG. 7B is an overview showing a method for recognizinga voice command of a mobile terminal according to an embodiment of thepresent invention. As shown in FIG. 7B, the user inputs a voice commandas a natural language composed of six words “I want to see my pictures.”In this example, the recognition rate can be judged based on the numberof meaningful words (e.g., see, pictures) relating to a specific menu(e.g., photo album). In addition, the controller 180 can determinewhether the words included in the voice command are meaningful wordsrelating to a specific function or menu based on the information storedin the database. For instance, meaningless words included in the naturallanguage voice command that are irrelevant to the specific menu may bethe subject (I), the preposition (to), and the possessive pronoun (my).

Also, the natural language is a language commonly used by people, andhas a concept contrary to that of an artificial language. Further, thenatural language may be processed by using a natural language processingalgorithm. The natural language may or may not include a precise namerelating to a specific menu, which sometimes causes a difficulty incompletely precisely recognizing a voice command. Therefore, accordingto an embodiment of the present invention, when a voice command has arecognition rate more than a certain level (e.g., 80%), the controller180 judges the recognition to be precise.

Further, when the controller 180 judges a plurality of menus to havesimilar meanings, the controller 180 displays the plurality of menus andthe user can select one of the displayed menus to have its functionsexecuted. In addition, a menu having a relatively higher recognitionrate may be displayed first or distinctively displayed compared to theother menus.

For example, FIG. 8 is an overview showing a method for displaying menusfor a voice recognition rate of a mobile terminal according to anembodiment of the present invention. As shown in FIG. 8, a menu iconhaving a higher recognition rate is displayed at a central portion ofthe display screen 510, or may be displayed with a larger size or adarker color as shown in the display screen 520. The menu icon havingthe higher recognition rate can also be displayed first and thenfollowed in order or sequential manner by lower recognition rate menus.

Further, the controller 180 can distinctively display the plurality ofmenus by changing at least one of the size, position, color, brightnessof the menus or by highlighting in the order of a higher recognitionrate. The transparency of the menus may also be appropriately changed orcontrolled.

In addition, as shown in the lower portion of FIG. 8, a menu having ahigher selection rate by a user may be updated or set to have arecognition rate. That is, the controller 180 stores a history of theuser selections (S301) and performs a learning process (S302) to therebyupdate a particular recognition rate for a menu option that is selectedby a user more than other menu options (S303). Thus, the number of timesa frequently used menu is selected by a user may be applied torecognition rate of the menu. Therefore, a voice command input in thesame or similar manner in pronunciation or content may have a differentrecognition rate according to how many times a user selects a particularmenu.

Further, the controller 180 may also store time at which the userperforms particular functions. For example, a user may check emails ormissed messages every time they wake up on Mondays through Fridays. Thistime information may also be used to improve the recognition rate. Thestate of the terminal (e.g., standby mode, etc.) may also be used toimprove the recognition rate. For example, the user may check emails ormissed messages when first turning on their mobile terminal, when theterminal is opened from a closed position, etc.

Next, FIG. 9 is an overview showing a method for recognizing a voicecommand of a mobile terminal according to another embodiment of thepresent invention. As shown in FIG. 9, the user activates the voicerecognition function, and inputs the voice command “I want to see mypictures.” The controller 180 then specifies a domain of a database forvoice command recognition into a domain relating to the displayedsub-menus. The controller 180 then interprets the voice command (S401)and in this example, displays a plurality of menus that have aprobability greater than a particular value (e.g., 80%) (S402). As shownin the display screen 610 in FIG. 9, the controller displays fourmultimedia menus.

The controller 180 also distinctively displays a menu having the highestprobably (e.g., the “Photo Album” menu option 621 in this example). Theuser can then select any one of the displayed menus to execute afunction corresponding to the selected menu. In the example shown inFIG. 9, the user selects the photo album menu option 621 and thecontroller 180 displays pictures in the selected Photo Album as shown inthe display screen 620.

Also, as shown in step S402 in the lower portion of FIG. 9, thecontroller 180 can also immediately execute a function when only asingle menu is determined to be higher than the predeterminedprobability rate. That is, the controller 180 displays the pictures inthe photo album as shown in the display screen 620 immediately withoutthe user having to select the Photo Album menu option 621 when the PhotoAlbum menu option 621 is determined to be the only menu that has ahigher recognition rate or probability than a predetermined threshold.In addition, even though a menu has a precise name such as “photoalbum”, the memory 160 can store a plurality of information relating tothe menu such as “photo, picture, album”.

Further, as discussed above with respect to FIG. 6B, the controller 180can also output help information to the user when a specific menu isselected or executed through a voice command or touch input according toan operation state or mode (e.g., a mode for indicating a voicerecognition function). In addition, the user can set the operation modefor outputting the help using appropriate menu options provided inenvironment setting menus. Accordingly, a user can operate the terminalof the present invention without needing or having a high level ofskill. That is, many older people may not be experienced in operatingthe plurality of different menus provided with terminal. However, withthe terminal of the present invention, a user who is generally notfamiliar with the intricacies of the user interfaces provided with theterminal can easily operate the mobile terminal.

In addition, when the controller 180 recognizes the voice command tohave a plurality of meanings (i.e., when a natural language voicecommand does not include a precise menu name such as when a menu isincluded in a ‘multimedia’ category but does not have a precise nameamong ‘camera’, ‘photo album’, and ‘video’), the controller 180 displaysa plurality of menus having a recognition rate more than a certain value(e.g. 80%).

Next, FIG. 10 is an overview showing a plurality of databases used bythe controller 180 for recognizing a voice command of a mobile terminalaccording to an embodiment of the present invention. In this embodiment,the databases store information that the controller 180 uses to judge ameaning of a voice command, and may be any number of databases accordingto information features. Further, the respective databases configuredaccording to information features may be updated through a continuouslearning process under control of the controller 180.

For example, the learning process attempts to match a user's voice witha corresponding word. For example, when a Korean word, ‘Saeng-il’(indicating ‘birthday’) pronounced by a user is misunderstood as‘Saeng-hwal’ (indicating ‘life’), the user corrects the word‘Saeng-hwal’ into ‘Saeng-il’. Accordingly, the same pronunciation to besubsequently input by the user is made to be recognized as ‘Saeng-il’.

As shown in FIG. 10, the respective databases according to informationfeatures include a first database 161, a second database 162, a thirddatabase 163, and a fourth database 164. In this embodiment, the firstdatabase 161 stores voice information for recognizing a voice inputthrough the microphone in units of phonemes or syllables, or morphemes.The second database 162 stores information (e.g., grammar, pronunciationprecision, sentence structure, etc.) for judging an entire meaning of avoice command based on the recognized voice information. The thirddatabase 163 stores information relating to menus for functions orservices of the mobile terminal, and the fourth database 164 stores amessage or voice information to be output from the mobile terminal so asto receive a user's confirmation about the judged meaning of the voicecommand

In addition, the third database 163 may be specified into informationrelating to menus of a specific category according to a domain presetfor voice command recognition, Also, the respective database may storesound (pronunciation) information, and phonemes, syllable, morphemes,words, keywords, or sentences corresponding to the pronunciationinformation. Accordingly, the controller 180 can determine or judge themeaning of a voice command by using at least one of the plurality ofdatabases 161 to 164, and execute menus relating to functions orservices corresponding to the judged meaning of the voice command.

Next, FIG. 11 is an overview showing a state that a voice recognitionfunction of a mobile terminal is being performed according to anembodiment of the present invention. As shown, when the controller 180is executing the voice recognition function, the controller 180 displaysa specific indicator or an icon 500 that informs the user the voicerecognition function is being executed. The controller 180 can alsooutput a sound or message to inform the user that the voice recognitionfunction is being executed.

Further, the above-described embodiments refer to recognizing the user'svoice instruction. However, the present invention is also applicable tothe user performing an additional input function while the voiceinstruction is being recognized. For example, a voice recognition and atouch input, a voice recognition and a button input, or a voicerecognition or touch/button inputs may be simultaneously performed.

In addition, the controller 180 may prevent the voice recognitionfunction from being performed in a particular mode or menu or in aparticular operational state. Further, audio information (e.g., voiceannouncement or guidance information) or video information (e.g., theindicator 500 in FIG. 11) indicating that a voice recognition functionis being applied may be displayed in the voice recognition mode, menu oroperational state. Also, information that the voice recognition functionis being applied may be provided to the user by outputting helpinformation.

FIG. 12 is an overview showing a method for processing sub-commandsrelating to a specific menu of a mobile terminal through a voice commandaccording to an embodiment of the present invention. In this embodiment,it is assumed the user has already activated the voice recognitionfunction.

Then, as shown in the left side of FIG. 12, the user touches theAlarm/Schedule icon, and the controller 180 displays a pop-up help menulisting available functions (e.g., 1) Alarm, 2) Schedule, 3) To do and4) Memo). Then, the user enters the voice command “To do,” and thecontroller 180 interprets the meaning of the voice command and displaysa plurality of menus that are determined to correspond to the voicecommand as shown in the display screen 611.

That is, as shown in the display screen 611, the controller 180 displaysfour events related to the To do function. The user then enters thevoice command “Select number 2,” and the controller 180 selects thenumber 2 option (Meeting 1). The user then enters the voice command “Iwant to delete this”. The controller 180 then displays a pop-up menu 613asking the user to confirm yes or no about deleting the entry. The userthen enters the voice command “yes” and the controller 180 then deletesthe entry as shown in the display screen 616 of FIG. 12.

In addition, if there is no response from the user, the controller 180may automatically execute the sub-commands by judging the response as apositive answer. The controller 180 also outputs a voice command 615informing the user that the item was deleted. Also, rather thanselecting the first menu Alarm/Schedule by touching the menu, the usercould have instead issued another voice command. Also, the controller180 can issue a voice message 617 when the user first selects theAlarm/Schedule icon to inform the user the corresponding task will beexecuted.

Further, as discussed above, when the specific menu is executed, thecontroller 180 specifies a domain of a database used as a reference forvoice command recognition into a domain relating to the executed menus.That is, the domain includes information relating to sub-menus of thespecific menu, or information relating to sub-commands that can beexecuted from the specific menu.

Next. FIG. 13 is an overview showing a method for searching a subway mapthrough a voice command in a mobile terminal according to an embodimentof the present invention. Again, in this example, it is assumed the userhas already activated the voice recognition function. Further, it isalso assumed that the controller 180 performs the specific menu relatedto displaying a Subway map based on the user's voice command ormanipulation using other input units.

That is, the controller 180 displays the subway map as shown in thedisplay screen 621. As discussed above, when the specific menu isexecuted, the controller 180 may specify a domain of database that isused as a reference for voice command recognition into a domain relatingto the executed menus (e.g., names for subway stations, distance (time)information between each station). Further, the domain includesinformation relating to the sub-menus of the specific menu, orinformation relating to sub-commands that can be executed from thespecific menu.

The controller 180 then issues a voice command 626 asking the user toenter start and end stations. The user then selects two stations on thedisplay screen 621. That is, the controller 180 receive two stations 622and 623 from the displayed subway map that the user wants to know theamount of time it takes to travel between the two stations. The user mayselect the two stations using a voice command when prompted by theterminal (i.e., say the start and end stations) or by touching the twostations 622 and 623. Other methods of selecting the two stations arealso possible. After the user selects the two stations, the controller180 outputs a voice message 624 that includes the two stations selectedvia a speaker (i.e., the ISU and Seoul station were selected). Also,rather than outputting a voice message, the controller 180 can insteaddisplay pop-up windows with the requested or input information.

Further, the controller 180 can also output help information when thetwo stations are selected. For example, as shown in the display screen621 in FIG. 13, the controller displays a help pop-up balloon windowlisting the name of the station and the color of the metro line. Theuser then requests the amount of time it will take to travel between thetwo selected stations. The user can request this information byinputting the voice instruction “I want to know how long it will takefrom ISU to Seoul Station”.

The controller 180 then detects meaningful words (e.g., how long, take,Isu, Seoul Station) relating to processing the subway map informationwithin the domain so as to analyze a context and content of the voicecommand. Based on the analyzed information, the controller 180determines that the voice command has a meaning to request timeinformation between the two subway stations Isu and Seoul Station.

Further, when the controller 180 judges the meaning of the voiceinstructions, the controller 180 may first request the user'sconfirmation about whether the judged meaning of the voice command isprecise. The controller 180 then displays the two stations on the subwaymap, along with a distance (or time) between the two stations, thenumber of stops between the two stations, etc. and outputs a voicemessage 627 informing the user about the result as shown in the displayscreen 625 in FIG. 13. Further, as described above, if the user doesn'trespond to the confirmation request within a particular time period, thecontroller 180 may interpret this as a positive response and provide theresults of the requested service.

Next, FIG. 14 is an overview showing a method for reproducing multimediafiles through a voice command in a mobile terminal according to anembodiment of the present invention. Further, the following descriptionassumes the user has input the activation control signal, and that thecontroller 180 starts to activate the voice recognition function. It isalso assumed the controller 180 has performed the specific menu relatedto multimedia reproduction menu by receiving input of a voice command ora user's manipulation using other input units.

That is, as shown in the display screen 631, the controller 180 displaysa list of songs that the user can select to be played. Thus, in thepresent invention, a user's desired multimedia file may be directlysearched through a voice command thus to be reproduced. In more detail,once a multimedia reproduction menu is executed, the controller 180specifies a domain of database used as a reference for voice commandrecognition into a domain relating to the executed menus.

As discussed above, the domain includes information relating tosub-menus of the multimedia reproduction menu, information relating tosub-commands that can be executed from the multimedia reproduction menu,or information relating to a multimedia file (e.g., file names,reproduction time, copyright owner, etc.).

Further, the controller 180 can display a multimedia file list byreceiving input of a voice command or a user's manipulation using otherinput units. In the example in FIG. 14, the user inputs their naturallanguage voice command (e.g., Let's play this song) under a state thatone file is selected from the file list as shown in the display screen631.

Once the voice command is input, the controller 180 detects meaningfulwords (e.g., play, this song) relating to the sub-menus or sub-commandsfor processing the selected menu within the domain. Further, thecontroller 180 judges a meaning of the voice command by analyzing thedetected words and an entire context and content of the voice command.

Once the meaning of the voice command is judged, the controller 180receive the user's confirmation about whether the judged meaning of thevoice command is precise. For example, as shown in FIG. 13, thecontroller 180 displays a pop-up window 633 asking the user to say “yes”or “No” regarding the playing of the selected song. The controller canalso output a voice message 632 asking the user if song 2 is the song tobe played. The user can then say “Yes” and the controller 180 outputsthe selected song as shown in the display screen 634.

Alternatively, the controller 180 can automatically play the selectedsong without asking the user to confirm the selection. The user can alsouse appropriate menu options to set as a default that the controller 180asks for confirmation about a selected task or does not ask for theconfirmation. Further, if there is no response from the user, thecontroller 180 can automatically execute the judged voice command byjudging the response as a positive answer.

Therefore, in this embodiment, a file to be reproduced is selected, anda reproduction command for the selected file is input through a voicecommand. However, when a user already knows a file name, the file namemay be directly input from an upper menu through a voice command.

Next, FIG. 15 is an overview showing a method for sending an email ortext message through a voice command in a mobile terminal according toan embodiment of the present invention. Again, this embodiment isdescribed assuming that the activation control signal has already beeninput, the controller 180 started to activate the voice recognitionfunction, and the controller 180 performed a specific menu (e.g.,mail/message send/reception menu) by receiving input of a voice commandor a user's manipulation using other input units.

In more detail, once a mail (or message) send/reception menu isexecuted, the controller 180 specifies a domain of database used as areference for voice command recognition into a domain relating to theexecuted menus. The domain includes information relating to sub-menus ofthe mail/message send/reception menu, information relating tosub-commands that can be executed from the mail/message send/receptionmenu, information relating to a sent/received mail/messages (e.g.,transmitter, receiver, transmitting/receiving time, title, etc.).

The controller 180 also displays a mail/message send/reception list byreceiving input of a voice command or a user's manipulation using otherinput units. As shown in the display screen 641, the user enters thevoice instruction “I want to reply.” The controller 180 then displaysthe received messages the user can reply to as shown in the displayscreen 645. In this example, the user uses his natural language (e.g.,Reply to this message) in a state that one mail/message is selected fromthe mail/message list as shown in the display screen 645.

Further, once the voice command is input, the controller 180 detectsmeaningful words (e.g., reply, this message) relating to a replyprocessing for the selected mail/message within the domain. Then, thecontroller 180 judges a meaning of the voice command (execution of amail/message reply menu) by analyzing the detected words and an entirecontext and content of the voice command.

Once the meaning of the voice command is judged, the controller 180 mayreceive a user's confirmation about whether the judged meaning of thevoice command is precise. For example, for the user's confirmation, avoice message 642 may be output, or a text-type message 643 may beoutput. When the message for a user's confirmation is output, the usercan reply through a voice or other input units. If there is no responsefrom the user, the controller 180 can automatically execute functionscorresponding to the judged meaning by judging the response as apositive answer. Then, when the mail/message reply menu is executed, thecontroller 180 automatically inputs the selected calling party'saddress/phone number in a mail/message writing window 644.

Therefore, in this embodiment, a mail/message to be replied is firstlyselected, and a reply command for the selected mail/message is inputusing a voice command. However, when a user knows information about acalling party, the mail/message reply to the calling party may bedirectly input through a voice command.

Further, the embodiment shown in FIG. 15 can be modified to correspondto sending text messages. In more detail, the controller 180 includessoftware to convert the user's voice into text such that the user cantell the terminal what he or she wants to say, and the controller 180converts the input voice into a text message. The controller 180 canalso display to the user the converted text so the user can confirm theconversion is acceptable. The user can then request the terminal sendthe text message to a desired user.

The modified embodiment is particularly advantageous because entering atext message by hand is a very laborious and tedious process. Many userswant to send a text message rather than calling a person for a number ofdifferent reasons, but do not want to go through the laborious processof manually selecting multiple keys to send a single text message. Themodified embodiment of the present invention allows the user to enterthe desired text information using their voice, and then sending thetext message to a desired party.

FIG. 16 is an overview showing a method for performing a phone callthrough a voice command in a mobile terminal according to an embodimentof the present invention. Similar to the above embodiments, thisembodiment also assumes the user has input the activation controlsignal, the controller 180 has activated the voice recognition function,and the controller 180 has executed a specific menu (e.g., a telephonedirectory or a menu list about recently received calls) relating to aphone call by receiving input of a voice command or a user'smanipulation using other input units.

Once the menu relating to a phone call is executed, the controller 180specifies a domain of database used as a reference for voice commandrecognition into a domain relating to the phone call. Further, thedomain includes information relating to originating calls, incomingcalls, missed calls, etc. and each phone-related information (e.g.,originating time, incoming time, transmitter, receiver, callingduration, calling frequency, etc.).

In addition, the controller 180 displays a phone call list by receivinginput of a voice command or a user's manipulation using other inputunits. That is, the user uses his or her natural language to input thevoice command (e.g., I want to see the received phone calls) as shown inthe display screen 711.

Once the voice command is input, the controller 180 detects meaningfulwords (e.g., see, received, phone, calls) relating to the phone callwithin the domain, and judges the voice command to have a meaning,“output received phone calls” by analyzing the detected words and anentire context and content of the voice command. Once the meaning of thevoice command is judged, the controller 180 outputs a list for receivedphone calls as shown in the display screen 712.

Further, the user then inputs the voice command “Call this person” undera state that an item is selected from the outputted list. As a result,the controller 180 judges that the voice command has a meaning, “call toa counter party of a selected received call”. Then, the controller 180receive the user's confirmation about whether the judged meaning of thevoice command is precise. That is, the controller 180 can output a voicemessage 713 or a text-type message 715.

The user can also reply through a voice or other input units. Asmentioned above, if there is no response from the user, the controller180 can automatically execute a function corresponding to the judgedmeaning by judging the response as a positive answer. The controller 180also output a message 714 indicating the call connection is being made.

Thus, in this embodiment, a calling party is selected from a phone calllist, and a call command to the selected calling party is input througha voice command. However, when a user already knows information aboutthe calling party, a call to the person may be directly executed througha voice command.

Next, FIG. 17 is an overview showing a method for using phone-bookinformation through a voice command in a mobile terminal according to anembodiment of the present invention. The same assumptions are made inthis description as described above in the other embodiments. That is,it is assumed that once an activation control signal is input, thecontroller 180 starts to activate the voice recognition function, andthe controller 180 selects or performs a specific menu (e.g., a phonebook menu) by receiving input of a voice command or a user'smanipulation using other input units as shown in the display screen 720.

Once the phone book menu is executed, the controller 180 specifies adomain of database used as a reference for voice command recognitioninto a domain relating to sub-menus of the phone book menu orsub-commands that can be executed from the phone book menu. Further, thedomain is specified so as to enhance a recognition rate, but may not benecessarily specified.

In addition, the user enters a voice command in their natural language(e.g., Edit James, Add James, Find James, Call James, I want to send aMessage to James) in a standby state or under a state that menusrelating to the phone book are selected. Once the voice command isinput, the controller 180 detects meaningful words (e.g., Edit, Add,Find, Call, Send Message, James) relating to the phone call within thedomain, and judges each meaning of the voice commands by analyzing thedetected words and an entire context and content of the voice commands.

Once each meaning of the voice commands is judged, the controller 180executes functions or menus corresponding to the respective voicecommands as shown in the display screens 722 to 724. Further, before theexecution, the controller 180 can receive a user's confirmation aboutwhether the judged meanings of the voice commands are precise. Asdiscussed above, for the user's confirmation, a voice message or atext-type message may be output.

In addition, when the message for a user's confirmation is output, theuser may reply through a voice or other input units. If there is noresponse from the user, the controller 180 can automatically executefunctions corresponding to the judged meanings by judging the responseas a positive answer.

Next, FIG. 18 is an overview showing a method for changing a backgroundscreen through a voice command in a mobile terminal according to anembodiment the present invention. Again, this description assumes thatonce an activation control signal is input, the controller 180 starts toactivate the voice recognition function, and performs a specific menu(e.g., a photo album menu) by receiving input of a voice command or auser's manipulation using other input units.

The photo album menu may be executed by input of a voice command orsub-menus of multi-steps using other input units. Also, the photo albummenu may be directly executed by a natural language voice command (e.g.,I want to see my photo album) as shown in the display screen 731.According to the judged meaning of the voice command, the controller 180outputs a photo list by executing a photo album menu as shown in thedisplay screen 732. Then, the controller 180 receive one photo selectedfrom the outputted photo album list.

Under this state, if a user's voice command (e.g., Change my wall paperusing this picture) is input, the controller 180 detects meaningfulinformation (e.g., change, wall paper) relating to sub-menus orsub-commands of the executed menu. Then, the controller 180 judges ameaning of the voice command by analyzing the detected words and anentire context and content of the voice command. That is, the controller180 judges the voice command to have a meaning “Change a backgroundscreen into a selected photo”.

Once the meaning of the voice command is judged, the controller 180displays the background screen to correspond with the selected photo,and receives a user's confirmation about whether the judged meaning ofthe voice command is precise. Here, for the user's confirmation, a voicemessage 733 may be output, or a text-type message 734 may be output. Thejudged voice command may also be directly executed without the user'sconfirmation according to a high recognition rate or a predefinedenvironment setting menu.

When the message for a user's confirmation is output, the user can replythrough a voice or other input units. If there is no response from theuser, the controller 180 can automatically execute a functioncorresponding to the judged voice command meaning by judging theresponse as a positive answer.

In order to change a background screen, the photo album menu may not benecessarily executed at first as shown in the present embodiment.Rather, after a background screen menu is executed, a user's desiredphoto may be searched to be changed.

FIG. 19 is an overview showing a method for reproducing multimedia filesthrough a voice command in a mobile terminal according to an embodimentof the present invention. Similar to the above embodiments, thisdescription assumes that once an activation control signal is input, thecontroller 180 starts to activate the voice recognition function, andperforms a specific menu (e.g., a multimedia reproduction menu) byreceiving input of a voice command or a user's manipulation using otherinput units.

In order to reproduce a multimedia file by a user, the specific menu isexecuted, one of sub-menus of the specific menu is selected to display afile list, and one file is selected from the file list thus to bereproduced. However, in the present invention, a user's desiredmultimedia file may be directly searched through a voice command thus tobe reproduced.

For example, if a specific voice command (e.g., Move to the Beatlesalbum) is input after the voice recognition function is activated, thecontroller 180 judges a meaning of the voice command by analyzing anentire context and content of the voice command as shown in the displayscreen 741. Based on the analyzed information, the controller 180executes specific functions or menus, or displays a file list by movingto a specific file folder as shown in the display screen 742.

When the voice command (e.g., Play this song or Play number 3) is inputafter one file is selected from the file list, the controller 180 judgesa meaning of the voice command by analyzing an entire context andcontent of the voice command. In addition, functions or menuscorresponding to the meaning of the voice command may be directlyexecuted according to a high recognition rate or a predefinedenvironment setting menu.

Once the meaning of the voice command is judged, the controller 180receives a user's confirmation about whether the judged meaning of thevoice command is precise. Here, for the user's confirmation, a text-typemessage or a voice message 743 may be output. When the message for auser's confirmation is output, the user can reply through a voice orother input units. If there is no response from the user, the controller180 can automatically execute a function of the judged voice command byjudging the response as a positive answer. The controller 18 thenexecutes or plays the selected song as shown in the display screen 744.

Thus, in this embodiment, a file to be reproduced is selected, and areproduction command for the selected file is input through a voicecommand. However, when a user knows a file name, the file name can bedirectly input from an upper menu through a voice thus to be reproduced.

Therefore, according to embodiments of the present invention, an inputvoice command is converted to a specific form in a state that a voicerecognition function is activated, and a context and content thereof arecompared with the database specified into a domain used as a reference.Further, a result value corresponding to a judged meaning of the voicecommand is output to a specific component of the mobile terminal

The mobile terminal of the present invention can control menus relatingto specific functions or services thereof by judging a meaning of aninput voice command based on a context and content. Further, the mobileterminal of the present invention can enhance a voice recognition rateby specifying a domain for voice recognition into a domain relating tospecific menus or services according to an operation state or anoperation mode thereof.

Also, the mobile terminal of the present invention can simultaneouslyselect or execute menus relating to specific functions or services, byapplying one or more user's interfaces (UI) thereof even while a voicerecognition function is activated, so as to detect a user'smanipulation. In addition, the mobile terminal of the present inventioncan control menus relating to specific functions or services through avoice command regardless of a user's skill, by providing helpinformation with respect to input of the voice command according to anoperation state or an operation mode thereof.

Further, the multiple domains can include at least two domains from anemail domain corresponding to emails sent and received on the mobileterminal, a scheduling task domain corresponding to scheduling eventsassigned on the mobile terminal, a contact domain corresponding tocontacts on the mobile terminal, a phonebook domain corresponding tophone numbers stored on the mobile terminal, a map domain correspondingto map information provided by the mobile terminal, a photo domaincorresponding to photos stored on the mobile terminal, a message domaincorresponding to messages sent and received on the mobile terminal, amultimedia domain corresponding to multimedia functions performed on themobile terminal, an external device domain corresponding to externaldevices the mobile terminal can connect to, a call history domaincorresponding to calls sent and received on the mobile terminal, and asettings domain corresponding to setting functions performed on themobile terminal.

Moreover, the predetermined threshold of the recognition rate can be setby a manufacturer of the mobile terminal or by a user of the mobileterminal.

In addition, the above various embodiments may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof. For a hardware implementation,the embodiments described above may be implemented within one or moreapplication specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), processors, controllers, micro-controllers, microprocessors,other electronic units designed to perform the functions describedherein, or a selective combination thereof.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory (for example, the memory 160), and executed by acontroller or processor (for example, the controller 180).

In addition, the mobile terminal 100 may be implemented in a variety ofdifferent configurations. Examples of such configurations include afolder-type, slide-type, bar-type, rotational-type, swing-type andcombinations thereof.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

1. A mobile terminal, comprising: an input unit configured to receive aninput to activate a voice recognition function on the mobile terminal; amemory configured to store multiple domains related to menus andoperations of the mobile terminal; and a controller configured to accessa specific domain among the multiple domains included in the memorybased on the received input to activate the voice recognition function,to recognize input user speech based on a language model and an acousticmodel of the accessed domain, and to determine at least one menu andoperation of the mobile terminal based on the accessed specific domainand the recognized user speech.
 2. The mobile terminal of claim 1,wherein when the input to activate the voice recognition is receivedwhile the mobile terminal is in a particular menu or operation, theaccessed specific domain corresponds to the particular menu oroperation.
 3. The mobile terminal of claim 2, wherein the particularmenu or operation includes at least one of a multimedia menu oroperation, a contacts menu or operation, a messaging menu or operation,a sounds menu or operation, an organizer menu or operation, a screenmenu or operation, a utilities menu or operation, a camera menu oroperation, and a setting menu or operation.
 4. The mobile terminal ofclaim 1, wherein the controller is further configured to determine arecognition rate that the determined menu and operation accuratelycorrespond to the input user speech.
 5. The mobile terminal of claim 4,further comprising: a display unit configured to display information,wherein the controller is further configured to output on the displayunit all menus and operations of the mobile terminal based on theaccessed specific domain and the recognized user speech that have beendetermined to have a recognition rate that is higher than apredetermined threshold.
 6. The mobile terminal of claim 5, wherein theinput unit is further configured to receive a voice input command forselecting one of the displayed menus and operations, and the controllerrecognizes the input voice command and outputs information inquiringabout whether the recognized input voice command is accurate.
 7. Themobile terminal of claim 5, wherein the controller is further configuredto output on the display unit said all menus and operations of themobile terminal based on the accessed specific domain and the recognizeduser speech that have the recognition rate that is higher than thepredetermined threshold in an order of a higher recognition rate to alower recognition rate.
 8. The mobile terminal of claim 5, wherein thepredetermined threshold is set by a manufacturer of the mobile terminalor by a user of the mobile terminal.
 9. The mobile terminal of claim 5,wherein the controller is further configured to discriminately displayon the display unit a menu or operation that has a highest recognitionrate by controlling at least one of size, a position, a color, abrightness, and a highlight of the menu or operation.
 10. The mobileterminal of claim 4, wherein the controller is further configured todetermine a number of times a specific menu or operation on the terminalhas been previously selected and to adjust the recognition rate for thespecific menu or operation based on the determined number of times thespecific menu or operation has been previously selected.
 11. The mobileterminal of claim 1, wherein the input unit includes at least one of 1)a touch soft button that is touched to activate the voice recognitionfunction, 2) a hard button that is pressed or manipulated to activatethe voice recognition function, 3) an arbitrary position of a touchscreen included in the input unit that is touched to activate the voicerecognition function, 4) an impact sound that is input to activate thevoice recognition function, 5) a local area radio signal or a remotearea radio signal, and 6) a body information signal from a user.
 12. Themobile terminal of claim 1, further comprising: a first databaseconfigured to store voice or pronunciation information that is used bythe controller to recognize the input user speech; a second databaseconfigured to store a word, a keyword or sentence information that isused by the controller to recognize the input user speech; a thirddatabase configured to store information related to functions or menusof the mobile terminal; and a fourth database configured to store helpinformation to be output to inform a user that the controller isattempting to determine a meaning of the input user speech.
 13. Themobile terminal of claim 1, wherein the controller is further configuredto output audio or video information indicating that the voicerecognition function is in an activated state.
 14. The mobile terminalof claim 1, wherein the multiple domains include at least two domainsfrom an email domain corresponding to emails sent and received on themobile terminal, a scheduling task domain corresponding to schedulingevents assigned on the mobile terminal, a contact domain correspondingto contacts on the mobile terminal, a phonebook domain corresponding tophone numbers stored on the mobile terminal, a map domain correspondingto map information provided by the mobile terminal, a photo domaincorresponding to photos stored on the mobile terminal, a message domaincorresponding to messages sent and received on the mobile terminal, amultimedia domain corresponding to multimedia functions performed on themobile terminal, an external device domain corresponding to externaldevices the mobile terminal can connect to, a call history domaincorresponding to calls sent and received on the mobile terminal, and asettings domain corresponding to setting functions performed on themobile terminal.
 15. A method of controlling a mobile terminal, themethod comprising: receiving an input to activate a voice recognitionfunction on the mobile terminal; accessing a specific domain amongstored multiple domains included in a memory of the mobile terminalbased on the received input to activate the voice recognition function;recognizing input user speech based on a language model and an acousticmodel of the accessed domain; and outputting at least one menu andoperation of the mobile terminal based on the accessed specific domainand the recognized user speech.
 16. The method of claim 15, wherein whenthe input to activate the voice recognition is received while the mobileterminal is in a particular menu or operation, the accessed specificdomain corresponds to the particular menu or operation.
 17. The methodof claim 16, wherein the particular menu or operation includes at leastone of a multimedia menu or operation, a contacts menu or operation, amessaging menu or operation, a sounds menu or operation, an organizermenu or operation, a screen menu or operation, a utilities menu oroperation, a camera menu or operation, and a setting menu or operation.18. The method of claim 15, further comprising: determining at least onemenu and operation of the mobile terminal based on the accessed specificdomain and the recognized user speech; and determine a recognition ratethat the determined menu and operation accurately correspond to theinput speech.
 19. The method of claim 18, further comprising: outputtingon a display unit of the mobile terminal all menus and operations of themobile terminal based on the accessed specific domain and the recognizeduser speech that have been determined to have a recognition rate that ishigher than a predetermined threshold.
 20. The method of claim 19,further comprising: receiving a voice input command for selecting one ofthe displayed menus and operations; recognizing the input voice command;and outputting information inquiring about whether the recognized inputvoice command is accurate.
 21. The method of claim 19, furthercomprising: outputting on the display unit said all menus and operationsof the mobile terminal based on the accessed specific domain and therecognized user speech that have the recognition rate that is higherthan the predetermined threshold in an order of a higher recognitionrate to a lower recognition rate.
 22. The method of claim 19, whereinthe predetermined threshold is set by a manufacturer of the mobileterminal or by a user of the mobile terminal.
 23. The method of claim19, further comprising: discriminately displaying on the display unit amenu or operation that has a highest recognition rate by controlling atleast one of size, a position, a color, a brightness, and a highlight ofthe menu or operation.
 24. The method of claim 18, further comprising:determining a number of times a specific menu or operation on theterminal has been previously selected and to adjust the recognition ratefor the specific menu or operation based on the determined number oftimes the specific menu or operation has been previously selected. 25.The method of claim 1, wherein the inputting step includes at least oneof 1) a touch soft button that is touched to activate the voicerecognition function, 2) a hard button that is pressed or manipulated toactivate the voice recognition function, 3) an arbitrary position of atouch screen included in the input unit that is touched to activate thevoice recognition function, 4) an impact sound that is input to activatethe voice recognition function, 5) a local area radio signal or a remotearea radio signal, and 6) a body information signal from a user.
 26. Themethod of claim 15, further comprising: storing, in a first database,voice or pronunciation information that is used to recognize the inputuser speech; storing, in a second database, a word, a keyword orsentence information that is used to recognize the input user speech;storing, in a third database, information related to functions or menusof the mobile terminal; and storing, in a fourth database, helpinformation to be output to inform a user that a meaning of the inputuser speech is being determined.
 27. The method of claim 15, furthercomprising: outputting audio or video information indicating that thevoice recognition function is in an activated state.
 28. The method ofclaim 15, wherein the multiple domains include at least two domains froman email domain corresponding to emails sent and received on the mobileterminal, a scheduling task domain corresponding to scheduling eventsassigned on the mobile terminal, a contact domain corresponding tocontacts on the mobile terminal, a phonebook domain corresponding tophone numbers stored on the mobile terminal, a map domain correspondingto map information provided by the mobile terminal, a photo domaincorresponding to photos stored on the mobile terminal, a message domaincorresponding to messages sent and received on the mobile terminal, amultimedia domain corresponding to multimedia functions performed on themobile terminal, an external device domain corresponding to externaldevices the mobile terminal can connect to, a call history domaincorresponding to calls sent and received on the mobile terminal, and asettings domain corresponding to setting functions performed on themobile terminal.